I don't see the need to replace them based on your description of the engine condition & history. Bearing failure is not that common on a VG30DE that has been taken care of.
Correct bearing replacement selection is rather tricky and subject to error. I would not feel the need to do this as a preventative measure. Cost of bearings does not factor in here.